LIBE  ^  :* 

rAV*  Tj  POSTGRADUATE  SCHOOL 

WBTEREY.    CALIF.    93940 


LIBRARY 

NAVAL  POSTGRADUATE  SCHOOL 

H,,uv,:Ph-7   PALTF.  93940  _ 


United    States 
Nava!   Postgraduate  School 


sf 


'<*> 


■  •  ■  r  o 


^ 


p»  >• 


TJJh 


'V- 


tsssss^ 


i-V  _4iU_  -ilk-  <1      <>■  »«. -S  A  *-*► X 


A  SEMI- 

MARKOV 

MODEL 

FOR 

MILITARY  OFF I 

CER  PE 

RSONNEL 

SYSTEMS 

by 

Randall  Walt 

sr  Austin 

The 

sis 

Advisor : 

K. 

T.  Mars 

hall 

September  1971 


Approved  jJoa.  public  fidU.a&><Li   dUfrilbutLon  unlimited. 


A  Semi -Markov  Model  for 
Military  Officer  Personnel  Systems 

by 


Randall  Walter  Austin 

Major,  United  States  '/Marine  Corps 

A.B.,  Dartmouth  College,  1958 


Submitted  in  partial  fulfillment  of  the 
requirements  for  the  degree  of 


MASTER  OF  SCIENCE  IN  OPERATIONS  RESEARCH 


from  the 

NAVAL  POSTGRADUATE  SCHOOL 
September  1971 


ABSTRACT 

The  military  officer  personnel  system  is  modeled  as  a 
semi-Markov  process.   The  probability  distributions  de- 
scribing state  transitions  are  developed  in  terms  of  policy 
variables.   Effects  of  changes  in  promotion  policy  and  force 
size  are  studied  for  both  a  closed,  steady  state  system  and 
an  open,  transient  situation.   Moments  of  the  joint  distri- 
bution of  officers  in  each  rank  are  presented  for  all  cases. 
A  method  for  approximation  of  transient  results  from  known 
distributions  is  formulated. 
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I.   INTRODUCTION 

Personnel  systems  composed  of  a  formal  rank  or  grade 
structure  that  utilize  a  promotion  procedure  to  move  per- 
sons through  or  out  of  the  system  are  commonplace  in  modern 
large  organizations.   In  particular,  the  Officer  Corps  of 
each  of  the  military  services  provides  a  classic  example 
of  this  type. 

Military  officer  promotions  are  controlled  by  federal 
laws  such  as  the  Officer  Personnel  Act  of  1947  and  the 
Officer  Grade  Limitation  Act  of  1954.   Additional  constraints 
may  be  imposed  by  service  Secretaries,  frequently  acting  as 
approving  authority  for  the  respective  service's  internally 
generated,  promotion  plan. 

Statutory  ceilings,  often  further  reduced  by  service 
policies,  exist  on  the  maximum  number  of  officers  holding  a 
particular  rank.   Promotion  boards  meet  annually  to  select 
officers  for  promotion  to  the  next  higher  rank.   Total  num- 
bers to  be  promoted  are  established  in  accordance  with  pre- 
vious and  projected  attrition.   The  size  of  the  promotion 
zone  -  those  officers  to  be  considered  for  selection  -  is 
based  on  a  promotion  opportunity  parameter,  e.g.,  500  pro- 
motions might  be  obtained  by  a  501  opportunity  from  a  1000 
man  zone,  or  by  a  801  opportunity  from  a  zone  of  625. 

Time  in  grade  -  the  number  of  years  an  officer  has 
spent  in  his  current  rank  -  is  a  secondary  consideration  in 
fixing  the  size  of  the  zone.   That  is,  the  ma>  mum  speed 


with  which  an  individual  may  move  through  the  system  is  a 
function  of  the  size  of  the  zone  each  year. 1 

Thus,  there  exist  three  policy  variables,  (1)  total 
number  in  each  rank,  (2)  promotion  opportunity  to  next 
rank,  and  (3)  time  in  grade,  which  control  the  functioning 
of  the  promotion  system. 

The  purpose  of  this  paper  is  to  present  a  mathematical 
model  of  the  flow  of  personnel  through  this  type  multi- 
grade  system  and  to  study  both  long  range  effects  of  a  given 
promotion  policy  and  short  term  effects  of  a  change  in 
policy.   The  paper  is  written  in  four  parts.   In  Part  II 
we  formulate  a  semi -Markov  process  model  and  define  its 
variables  and  properties.   Part  III  contains  steady  state 
results,  anci  in  i-arr  j.  v  we  giscuss  "transient  results  anci 
derive  a  method  to  approximate  them. 


i 

Accelerated  promotions  "below  the  zone"  do  occur.   They 
account  for  less  than  5%  of  the  total  promoted  but  will  be 
included  in  all  probability  distributions  dis(  ssed  in  this 
paper. 


II.   MODEL  FORMULATION 

Personnel  flow  models  in  which  movement  from  state- to  - 
state  in  successive  time  periods  is  assumed  to  follow  a 
Markov  chain  have  received  considerable  attention  in  the 
literature  (e.g.,  Bartholomew  [1],  Gani  [3]).   An  extension 
of  a  Markov  chain  model  which  accounts  for  some  of  the  non- 
Markov  properties  of  personnel  systems  is  to  model  such  a 
system  as  a  semi -Markov  process  (S.M.P.),  i.e.,  a  process 
whose  sequence  of  states  forms  an  embedded  Markov  chain  at 
the  transition  points,  where  the  system  changes  state,  and 
in  which  the  lengths  of  time  between  these  transitions  are 
random  variables  (see  Pyke  [6]). 

Let  us  first  formulate  an  "open  model."  That  is,  if 
state  j,  j  =  1,2,..., 6,  is  the  rank  of  an  active  military 
officer  and  state  7  is  an  absorbing  state  containing  those 
officers  who  are  retired,  resigned,  deceased  or  otherwise 
"out  of  the  service,"  then  ranks  1  through  6  are  a  set  of 
transient  states  that  form  the  "system."  Persons  leaving 
this  set  of  states  must  be  replaced  by  new  recruits  into 
the  system  if  it  is  not  to  empty  over  time.  Figure  1  il- 
lustrates movement  in  an  open  model. 

By  controlling  the  input  flow  of  new  personnel  we  can 
control  the  total  number  in  the  system.   If  that  control  is 
such  that  in  any  time  period  the  number  of  departures  is 
equal  to  the  number  of  arrivals,  the  number  in  the  system 
remains  constant.   Since  in  this  paper  we  beg  i  by  studying 


a  system  of  fixed  size  (in  Part  IV  this  assumption  is  re- 
laxed) we  can  "close"  (see  Cinlar  [2])  the  model  by  arti- 
ficially closing  the  feedback  loop  shown  as  a  dotted  line 
in  Figure  1. 
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Figure  1.   Personnel  Movement  in  Open  Model. 


Now  consider  a  system  with  7  states,  where  state  7  is 
artificial  and  represents  the  absorbing  state  for  those 
leaving  active  service  and' from  which  a  new  recruit  comes 
to  enter  the  active  states  and  replace  the  departing  officer 
(although  he  does  not  necessarily  enter  the  state  from  which 
the  departure  occurred) . 

As  we  shall  see,  the  times  taken  to  move  from  state  to 
state  in  the  model  play  an  important  role,  and  for  states  1 
through  6  these  times  are  dependent  on  policy  decisions.   By 
fixing  the  time  to  move  from  the  artificial  state  7  back  to 
the  active  states  at  zero  (instantaneous  replacement) ,  we 
can  remove  state  7  from  the  system  entirely  and  close  the 
loop  in  Figure  1  without  it.   Thus  we  are  lef  with  a 


closed  system  of  6  recurrent,  non-null  states  in  our  semi- 
Markov  model . 

It  is  a  system  of  this  type  which  will  be  considered  in 
this  paper,   We  shall  allow  inputs  to  the  system  to  occur 
only  at  rank  1.   In  Part  IV  we  evaluate  increases  of  overall 
size  by  new  cohort  inputs  to  the  fixed  size. 

We  now  pursue  the  system  containing  states  1,  2,  3,  4, 
5,  6,  the  officer  ranks  from  01  to  06. 2   As  time  passes  an 
individual  officer  moves  through  the  system  from  state  to 
state.   A  transition  occurs  when  he  moves  to  the  next  higher 
state  via  promotion  or  when  he  leaves  the  service,  in  which 
case  he  returns  to  state  1  and  is  "replaced"  as  previously 
described.   We  now  assume  that  the  sequence  consisting  of 
points  immediately  following  transition  points  forms  a 
Markov  chain.   It  is  significant  to  note  here  that  the  va- 
lidity of  this  Markovian  assumption  is  established  by  the 
special  structure  of  the  military  promotion  system  *  an 
officer  either  moves  up  to  the  next  rank  or  he  leaves  the 
system.   Thus  knowledge  of  only  the  present  rank  provides 
complete  information  concerning  the  probabilities  for  the 
next  transition. 

Times  between  transitions  are  random  variables  that  de- 
pend only  on  the  current  state  and  the  state  to  which  the 


2Rank/ Grade 

USA-USAF-USMC  TITLE 

USN  TITLE 

01 

Second  Lieutenant 

Ensign 

02 

First  Lieutenant 

Lieutenant  j . g 

03 

Captain 

Li  utenant 

04 

Maj  or 

Li  utenant 

-  .iimander 

05 

Lieutenant  Colonel 

Commander 

06 

Colonel 

Captain 

transition  will  be  made.   Implicit  here  is  the  assumption 
that  accelerated  or  delayed  promotions  do  not  affect  later 
behavior . 

Formally  then,  consider  the  state  space  {1,  2,  3,  4,  5, 
6}3,  the  first  six  officer  ranks.   Let  {Z,   (t)  =  i}  be  the 
event  officer  k  is  in  rank  i  after  a  time  t  in  service. 
Then  the  stochastic  process  (Z,(t),  t  >  0}  is  a  semi-Markov 
process  (S.M.P.).   The  stochastic  process  that  records  the 
number  of  times  the  S.M.P.  has  entered  each  of  the  system 
states  is  called  a  Markov  Renewal  Process  (M.R.P.),  as  named 
by  Pyke  [6,7].   The  S.M.P.  and  the  associated  M.R.P.  are  usu- 
ally discussed  together  in  the  literature.   However,  the 
special  structure  of  a  personnel  system  is  such  that  the 
following  discussion  will  oe  limited  to  the  S.M.P. 

We  shall  assume  that  each  officer  in  the  system  fol- 
lows an  independent  path  from  the  same  S.M.P. h      I f  we  let 
X. (t)  be  the  number  of  officers  in  rank  j  at  a  time  t,  then 
{X(t),  t  >  0}  where  X(t)  =  (X^t),  X2  (t)  ,  .  .  .  ,X6  (t) ) T ,  is 
a  multi-particle  semi-Markov  process  generated  by  the  S.M.P. 

We  can  now  define 


Q.  . (t)  -  P 


=  P 


process  next  makes  a  transi- 
tion into  j  and  this  occurs 
in  a  time  <  t 

officer  k  next  goes  to  rank 
j  and  this  occurs  in  a  time 
<  t 


process  has 
just  entered 
i 


-.C1) 


he  has  just 
attained  rank 
i 


3The  state  space  could,  of  course,  be  des  ribed  in  gen- 
eral. It  is  limited  to  the  specific  case  to  1  discussed  to 
simplify  subsequent  notation. 

\See  Heyman  [4]  definition  of  a  Multi-particle  SMP. 
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p. . (t)  =  p 


=  p 


state  at  time  t  is  j 


officer's  rank  at  time 
t  is  j 


P  [Zv(t)  =  j  |  Zv(0)  =  i]. 


process 
started  in 
state  i  at 
time  0 


officer 
started  in 
rank  i  at 
time  0 


-,(2) 


F.  . (t) 


=  P 


=  P 


a  transition  will  occur 
in  an  amount  of  time  <  t 


officer's  rank  will 
change  in  an  amount  of 
time  <  t 


process  has 
just  entered 

i  and  will 
next  enter  j 


officer  has 
just  attained 
rank  i  and 
will  next 
hold  rank  i 


(3) 


HiOO 


=  P 


=  P 


next  transition  occurs 
in  an  amount  of  time 
<  t 


time  officer  spends  in 
rank  i  <  t 


process  has 
just  entered 


he  has  just 
attained 
rank  i 


(4) 


G.  . (t)  =  P 


first  transition  into 
state  j  occurs  in  a  time 
<  t 


process 
starts  in  i 


(5) 


It  should  be  noted  that  G. - (t)  does  not  have  a  meaningful 
explanation  in  terms  of  the  functioning  of  the  officer  sys 
tern.   However,  its  usefulness  in  the  derivatio   of  further 
results  merits  its  inclusion  in  the  development. 
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Since  0- - M  is  the  probability  that  the  next  transi- 
tion  is  into  state  j  given  the  process  has  just  entered  i, 
we  define: 

so  that  p. .  is  the  fraction  of  those  who  reach  rank  i  who 
ever  attain  rank  j . 

Denoting  the  matrix  of  Q-. (t)  by  Q(t)  [we  will  hence- 
forth use  the  notation  Q(t)    =    (Qi-(t))]  we  write 


S(")  ■ 


«11 

q21 

q31 

q41 

q51 
1 


'12 
0 

0 

0 

0 

0 


0 

0 

0 

0 

23 

0 

0 

0 

0 

P34 

0 

0 

0 

0 

P45 

0 

0 

0 

0 

p56 

0 

0 

0 

0 

(6) 


J 


where  q.,  =  1  -  P--+1  is  the  fraction  of  those  who  reach 
rank  i  but  are  never  promoted  to  rank  i+1  and  are  replaced 
by  new  officers  in  rank  1. 

It  should  be  re -emphasized  that  this  matrix  defines  a 
closed  system  -  a  system  in  which  the  number  of  officers  N 
remains  fixed  with  no  extra  entering  or  leaving  the  system 
over  time.   Thus,  mathematically  we  have  a  certain  fraction 
leaving  each  state  and  returning  to  state  1  with  the  inter- 
pretation of  instantaneous  replacement  by  a  new  officer. 

Recalling  that  Qi . (t)  is  the  joint  probal  ility  of  the 
next  transition  from  i  to  j  and  in  a  time  less  than  t  we  have 
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Since  Q. . M  is  the  probability  that  the  next  transi- 
tion is  into  state  j  given  the  process  has  just  entered  i, 
we  define: 

QijW  ■  Pij 

so  that  p.-  is  the  fraction  of  those  who  reach  rank 
ever  attain  rank  j . 

Denoting  the  matrix  of  Q±- (t)  by  Q(t)    [we  will 
forth  use  the  notation  Q(t)    =  CQi4(t))]  we  write 


i  who 


hence 


Q(°°)    = 


111 

p12 

0 

0 

0 

0 

*21 

0 

P23 

0 

0 

0 

q31 

0 

0 

P34 

0 

0 

<Ul 

0 

0 

0 

P45 

0 

^51 

0 

0 

0 

0 

P56 

1 

0 

0 

0 

0 

0 

(6) 


where  q±1  -  1  -  Pii+1  is  the  fraction  of  those  who  reach 
rank  i  but  are  never  promoted  to  rank  i+1  and  are  replaced 
by  new  officers  in  rank  1. 

It  should  be  re-emphasized  that  this  matrix  defines  a 
closed  system  -  a  system  in  which  the  number  of  officers  N 
remains  fixed  with  no  extra  entering  or  leaving  the  system 
over  time.   Thus,  mathematically  we  have  a  certain  fraction 
leaving  each  state  and  returning  to  state  1  with  the  inter- 
pretation of  instantaneous  replacement  by  a  new  officer. 

Recalling  that  Q^  (t)  is  the  joint  probal  Llity  of  the 
next  transition  from  i  to  j  and  in  a  time  less  than  t  we  have 
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F   ft")  =   1J  ,         =  _±J 

ijl  J   Q-  ■  («»)    p.- 


and  thus 

6  6 


j-l  j  =  l 

It  can  be  shown  (Pyke  [6])  that 

6    t 

P..W  -  6..  [  1  -  H.(t)  ]  +  X   /  Pkj(t-x)dQik(x) 


k=l   o 

where  6..  is  the  Kroneker  delta. 

If  we  let  H. (t)  =  1  -  H. (t)  and  Q. . (t)  *  Pt  - (t)  indi - 
i v  J  l v  J  xi j K   J  kj  v  J 

cate  the  convolution  we  obtain 

6 
P.-Ct)  -  5,,  H  (t)  +  )      Q..  *  Pv,(t)   i,j  =  1,2,. ..,6. 

k=l 

The  matrix  form  of  these  equations  is 

P(t)  =  FD(t)"  +  Q    *  P(t)  (7) 

where  #n(t)  is  a  diagonal  matrix  of  H.(t),  and  5(t)  *  P(t] 
is  the  matrix  convolution.5 

A  similar  relationship  between  G..(t)  and  Q..(t)  can 
be  defined  as 

6    t  t 

Gij(t)  =  Z  J   Gkj(:t"x:)dQikCx)  +  /  l-Gjj(t-x)dQ.j(x)  (8) 
k=l  o  o 

with  the  matrix  form 


5A  convolution  of  matrix  valued  function    s  similar  to 
matrix  multiplication  except  the  product  of  elements  is  re- 
placed by  the  convolution  of  elements. 
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Git)    =  Q    *  G(t)  +  <2(t)  -  $  *  GD(t).  (9) 

In  terms  of  the  policy  variables  of  Part  I  we  can  now 

define  (Ross  [8])  the  average  amount  of  time  spent  in  rank 
i  as 


CO  oo 

»±    =  J      t  d  H.(t)  =  J    H.(t), 


and  the  average  time  spent  in  rank  i  given  the  next  transi 
tion  is  to  rank  j 

t  dF,,(t)  =  f    1 


t  °°  i 

Hi    -  J    t  dFij(t)  -J" 

o  o   \ 


1  -  -±1 dt. 


Finally,  the  mean  first  passage  time  from  i  to  j  is 


.  =  I   t  d  G.  .ft)  for  G.  .  (°°)  =  1 

o 


Although  the  concept  of  first  passage  is  of  little  direct 
use  in  this  model,  it  should  be  noted  that  G,,(«)  is  the 
distribution  of  lifetime  in  the  system.   For  the  most  part, 
however,  £(t)  will  be  used  to  derive  other  results  which 
are  in  terms  of  the  policy  variables. 

In  the  officer  promotion  system  we  can  consider  Q{t) 
(and  thus  //^(t)  ,  u .  and  r\ .  . )    as  known  since  the  Q--(t)  are 
determined  by  promotion  policies  and  officer  behavior  pat- 
terns.  Parts  III  and  IV  will  discuss  the  unknown  P(t), 
whose  first  row  is  of  primary  importance.   NP.  .  (t)  ,  j  = 
1,2,..., 6,  gives  the  expected  number  of  the  N  officers  who 
are  in  rank  j  at  time  t.   For  large  t,  the  P. .   )  can  be 
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interpreted  as  the  fraction  of  officers  expected  to  be  in 
rank  j.   Thus,  to  evaluate  the  long  term  effect  of  a  given 
policy,  the  limiting  form  of  P(t)  is  required  and  its  deter- 
mination directly  from  (7)  is  formidable.   The  introduction 
of  the  distribution  G(«)  and  in  particular  (9)  will  simplify 
the  task. 

Measurements  of  the  limiting  form  of  P(t)  could,  of 
course,  be  done  directly  via  a  cohort  type  model  (e.g., 
Marshall,  [5]),  but  these  direct  measurements  do  not  give 
any  information  as  to  how  changes  in  policy  affect  the 
P.  .  (t)  's. 
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III.   STEADY  STATE  RESULTS 

Let  us  first  examine  the  output  of  this  model  after  a 
long  period  of  time;  that  is,  in  the  steady  state. 

In  the  steady  state,  the  limiting  form  of  P(t)  contains 
the  distribution  of  the  N  officers  over  the  6  states.   We 
shall  see  that  its  solution  is  indirectly  in  terms  of  pol- 
icy variables  and  will  illustrate  how  the  effects  of  pol- 
icy changes  can  be  measured  in  terms  of  the  parameters  of 
the  model . 

Defining  the  Laplace  Stieltjes  Transform  (L.S.T.)  of 
the  function  F  as 

oo 

F(s)  =  I     e"sx  d  F(x)  s  >  0 

o 

we  solve  simultaneously  equations  (7)  and  (9) . 

First,  taking  transforms  of  (7)  we  obtain 

P(s)  =  fD(s)  +  S(s)  P(s),  (10) 

which  can  also  be  written 

[I-Q(s)]'1   =  P(s)  iDCs)-1.  (11) 

Likewise,  transforms  in  (9)  yield 

G(s)  =  Q(s)  -  Q(s)  3D(s)  +  Q(s)  C(s)  (12) 
which  can  be  simplified  to 

[I-S(s)]"1  =  I   +  G(s)  (I-SD(s))_1.  (13) 

Equating  (11)  and  (13)  we  have  the  result 

P(s)  =  fD(s)  +  3(s)  4D(s)  (14) 
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where  4q(s)  is  a  diagonal  matrix  with  elements 


E .  (S) 

11  *■  ' 

To  analyze  the  steady  state  results  we  now  find  lim  P(t) 

t-*-°° 
or  equivalently  the  lim  P(s) .   Thus, 

s+0 

/\  /N  /\  /\ 

lim  P(s)  =  lim  #D(s)  +  lira  ff(s)  lim  4D(s)  =  0 
s-*-0        s->0         s->0      s->0 


+  1    lim 
s+0 


0 


H^s) 
Gn(s) 
0 

* 

0 


where  1    is  a  6x6  matrix  of  l's. 

Now,  using  L' Hospital's  rule  we  see  that 


lim 


H,  (s) 


=  lim 


H!  (s-)     u- 

l  v  '  i 


s+0  G.  .  (s)    s+0  G!  .  (s) 


li 


H6(s) 


G66Cs^ 


so  that  finally  we  can  say 


lira  P(t)  =  lim  P(s)  = 
t-*00        s-*-0 


(15) 


We  will  now  define  (see  also  Ross  [8])  t%   terms  in  each 
row  of  this  matrix  of  limiting  probabilities  as 
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P.  =  lim  P..(t)  =  -J_  ,  j  =  1,2,.. .,6,      (16) 

that  is,  in  the  steady  state  the  fraction  of  officers  in  rank 
j  equals  the  ratio  of  expected  time  in  rank  j  to  expected 
recurrence  time  from  rank  j  back  to  j . 

However,  since  it  was  previously  noted  that,  with  the 
exception  of  (j,,,  the  y .  .  have  no  recognizable  meaning  with- 
in a  personnel  system  structure  it  is  desirable  to  develop 
an  expression  for  P,  .  (°°)  =  P.  which  is  in  terms  of  policy 
variables . 

Consider  the  embedded  Markov  chain  and  the  long  run 
proportion  of  transitions  into  each  rank  j;  that  is,  the 
solution  vector  {II.,  j  =  1,2,. ..,6}  to 

n  -  n  Q(«). 

Using  Q(°°)  as  structured  in  (6)  we  arrive  at 


TT 


1  6    Jfr 

1  +  I   TT  Pk,k+1 

j=2   k=l 

Z-l 

TT  Pk,k+i 

tt£    ■     C~X      6       -^ fi    =    2,3,...    6 

1  +  Z  TT  pk,k+i 

j=2  k=l 
It  can  also  be  shown6  that 


6These  results  on  the  expression  of  P.  ir  ;erms  of  it. 
are  due  to  Ross  [8]  ,  pp .  104-10  5  .         -1 
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»u  ■  "i +  Z  pik  ykj 


and  combining  this  with  P.  =  \i./\i..    we  have 

tt  .  y  . 
p   =  3 3 i  =  1  2      6 


En.  y. 
3   J 


i=l 

By  substituting  the  values  of  IT.  derived  above  we  obtain  the 


key   result 


ft 

6  i 

i +  E  yi  TT  Pk,k+i 


Pj    ■      6       '       i-x  3         1,2,..., 6     (17) 


i=2  k=l 

where  the  numerator  of  P1  is  defined  as  u-%  .  Hence,  equa- 

tion  (17)  is  an  expression  for  the  fraction  of  officers  in 

the  system  that  are  in  rank  j  in  the  steady  state,  in  terms 

of  mean  times  in  grade  and  elements  of  £(°°)  -  six  y.  and 

five  p...   Thus  each  P.  is  a  function  of  at  most  eleven 
*i3  3 

parameters,  but  can  be  computed  without  use  of  the  detailed 

structure  of  Q--(t)  or  H.(t). 

It  is  interesting  to  note  the  effect  of  parameter 

changes  in  (17)  .   For  any  j  it  is  easy  to  verify  that  when 

P..,,  is  increased(decreased) : 
n  +  1  v         J 

P.  increases (decreases)   i  <  i 
3 

P.  decreases (increased)   i  >  j. 

To  evaluate  the  sensitivity  of  P.  to  chan   s  in  a  par- 
ticular y. ,  let  us  first  consider  the  case  of  a  change  of  a 
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specified  amount.   The  denominator  of  (17) 

Vy2p12  +  y3P12p23  +  y4P12p23P34  +  y5p12p23p34p45 

+y6P12P23P34P45P56 

then  is  affected  most  by  a  change  in  y, ,  since  the  coeffi- 
cients of  y.  i  =  2,.. 6   are  less  than  unity.   Similarly,  P. 
becomes  less  sensitive  to  this  type  change  in  y .  as  i  in- 
creases from  1  to  6.   However,  if  a  percentage  change  in  a 
y.  is  considered  then  the  actual  values  of  the  y.  and  p.. 
will  determine  the  y.  to  which  P.  is  most  sensitive.   For  a 
set  of  parameter  values  that  approximate  current  policy  in 
all  military  services,  y0  is  the  most  critical  parameter 
for  percentage  change  analysis. 

The  case  where  all  \i-=\i    and  all  p--=p  provides  further 
insight  into  the  effect  of  parameter  changes.   Here  (17)  be- 
comes 

j-l  j-l     J 

p  =    v   P =  p    "  P 

J        X  6 

.  V     i-1       1-P 

i  =  2 
which  shows  that  in  this  special  case  P.  is  independent  of 
y.   Figure  2  gives  the  plot  of  P.  versus  j  for  various  values 
of  p . 

Returning  to  the  concept  of  the  MSMP (Multiparticle)  we 
can  now  consider  the  joint  distribution  of  the  number  of  of- 
ficers in  each  rank.   Since  P.  is  the  probability  of  reaching 
state  j  in  a  single  trial,  and  the  movement  of   ach  officer 


19 


6<- 


.4 


« 
^ 


o 
i— i 

H 
< 


.2  _ 


.1  .. 


1-^ 


Figure  2.   Distribution  in  Rank  for  p. .  : 
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is  an  independent  path,  the  joint  distribution  is  multi- 

T 
nomial;  that  is,  X(«)  =  (X1 ,X2 , . . . ,X6)   is  distributed 

T 

multinomial   with  parameters   N   and  P  where   P   =    [P^ ,P2 , • • • ,P^]    , 

a   row   from  P  (°°)  . 
Thus, 


Xl    =    xl> 


Xo  Xo  j 


.X, 


I**- 


N 


i  =  l 


(18) 


N! 


X-        X  X 

r-     P,       iP0      L  .   .   .V,      ° 

xTT     12  6 

o 


"1"      2*    ' 

For   the    steady   state    effect   of   a   given  policy   we    can 
then   say   that 


E[X(oo)]    =      N 


D 

x3 


N 


and 


P-iCl-PJ   -Pip 


V[X(oo)]    =    N 


-P    P 

-P   P 
*3    1 

-P    P 
-P   P 

-p  p 


V  2 
P2d-P2) 


-P   P 
Fr  3 

-P    P 
F2F3 


-P3P2        P3(l-P3) 


P    P 
*1    4 

P    P 
r2    4 

■P,P, 
3   4 


-P   P 
*4    2 

"P5P2 
-P6P2 


P   P 
M    3 


(19) 


-P,PC 

l    5 

-P2P5 
"P3P5 


p4ci-p4)    -V5 


-P   P 
hl    6 

"P2P6 

"P3P6 

"P4P6 

-P5P6 


-P5P3  "P5P4        V^V 

"P6P3  "P6P4  "P6P5        V^V 


J 


Hence,  X.  and  X.  are  not  independent,  but  are  negatively 
i      J 

correlated  such  that 
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p.  p. 

p(X. ,X.)  = 5— J 


l'  j 

•(1-PiJCi-Pj) 

For  large  N  the  distribution  of  X(°°)  is  approximately 

multivariate  normal.   Thus  the  distributions  of  each  X.  are 

i 

approximately  univariate  normal  with  mean  and  variance  given 
by  the  appropriate  elements  of  the  mean  vector  and  covariance 
matrix  above;  e.g., 


X_  -  NP 

'    $(0,1) 


/NP3(i-p3r 


This  enables  us  to  make  probability  statements  about  the 
number  of  officers  in  any  rank  in  the  steady  state. 

Returning  to  the  simplified  case  of  just  two  parameters, 
we  illustrate  the  correlation  between  the  numbers  of  officers 
in  two  different  ranks.   Namely,  for  p  =  .7 

6  /(1-P3)(1-P6) 

=  -.021. 

Thus,  the  effect  of  a  change  in  the  number  in  rank  3  on  the 
number  in  rank  6  (and  vice  versa)  is  small . 

It  is  not  the  purpose  of  this  paper  to  describe  de- 
tailed methods  of  finding  the  distributions  or  estimating 
the  parameters  used  in  this  model.   It  must  be  noted,  how- 
ever, that  the  u-  and  p.   are  not  themselves  the  policy 
variables  of  a  personnel  system  as  described  in  Part  I,  but 
rather  are  functions  of  those  policy  variable.    The  p.. 
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represent  the  fraction  of  those  that  enter  rank  i  that  go 
on  to  rank  j .   They  say  nothing  about  attrition  that  removes 
officers  from  the  system  (sends  them  back  to  rank  1)  prior 
to  their  consideration  for  promotion.   For  example,  consider 
p?_.   Let  us  assume  that  the  expiration  of  tours  of  obligated 
service  (EOS)  for  a  group  of  officers  occurs  during  the  time 
they  are  serving  in  rank  2.   If  2/3  leave  the  service  at 
EOS  or  before  with  terminal  grade  2,  only  1/3  are  later  con- 
sidered for  promotion  to  rank  3.   If  the  promotion  opportu- 
nity to  rank  3  (for  that  1/3)  is  .9,  then  we  may  approximate 

p23  =  C- 33)(.9)  =  .297. 

From  the  discussion  in  Part  II  on  the  various  moments 

used  in  the  model,  it  can  be  seen  that 

6 
Mi    =  2_,  Pij  ^ij         i  =  1,2,...  ,6.       (20) 

The  n- •  define  the  expected  time  spent  in  rank  i,  given  the 
next  rank  is  to  be  j .   For  each  i  the  summation  in  (20)  con- 
tains only  two  terms,  i.e.,  P^n^  +  piinii  +  i"   The  nii  +  l' 
expected  time  in  grade  of  those  to  be  promoted  to  the  next 
rank,  might  be  considered  an  actual  policy  variable.   The 
n • ,  are  consequences  of  decisions  on  the  t\ii+-\>    promotion 
opportunity,  and  the  various  other  forms  of  attrition.   As- 
suming three  years  in  grade  2  before  promotion.  1.5  year? 
in  grade  1,  three  years  obligated  service,  and  p.^  =  -30  we 
may  approximate 

y2  =  (.70) (1.5)  +  (.30)  3  =  1.95. 
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To  conclude  this  section  let  us  consider  a  more  com- 
plete example  of  this  steady  state  analysis  using  a  set 
of  parameters  developed  from  the  above  thoughts  and  rough 
approximations  to  current  military  policies. 

Let 


yl  = 

1. 

5 

Pl2 

=  .95 

y2  = 

2 

P23 

=  .3 

y3  = 

5 

P34 

=  .8 

^4  = 

5 

P45 

=  .75 

u5  - 

6 

P56 

=  .6 

y6  = 

7 

Using  (17)  we  calculate  the  fractions  expected  in  each  rank 

in  the  steady  state.   Table  I  presents  these  results,  the 

long  term  effect  of  increasing  u.  to  six  years,  and  the 

actual  1971  distribution  in  the  U.  S.  Marine  Corps  for  com- 
7 


parison . 

TABLE  I. 

FRACTIONS 

IN  RANK 

Approx, 

Increased 

Actual 

Rank 

Parameters 

M„ 

USMC 

1 

.195 

.188 

.132 

2 

.247 

.239 

.319 

3 

.185 

.180 

.275 

4 

.147 

.171 

.159 

5 

.133 

.128 

.080 

6 

.093 

.094 

.035 

From  (19)  and  the  above  results  it  follows: 


7Source  of  the  Marine  Corps  data  is  Combined  Lineal 
List   of  Officers  on  Active  Duty  in  the  Marine  Corps. 
1  January  1971,  NAVMC  P-1005-PD. 
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V[X(oo)]  =  N 


.157 

-.048 

-.036 

-.029 

-.026 

-  .018 

-.048 

.185 

-.046 

-.036 

-.033 

-.023 

-.036 

-.046 

.151 

-  .027 

-.025 

-.017 

-.029 

-.036 

-.027 

.125 

-.018 

-  .014 

-.026 

-.033 

-.025 

-.018 

.115 

-.012 

-.018 

-.023 

-.017 

-.014 

-.012 

.084 

Inspection  of  the  covariance  matrix  shows  V(X?)  as  the 
largest  and  V(Xfi)  as  the  smallest.   However,  from  Table  I 
we  note  that  the  numbers  of  officers  in  ranks  2  and  6  are 
largest  and  smallest  respectively.   To  provide  a  more  valid 
comparison  of  the  variation  in  each  of  the  ranks,  we  employ 
the  coefficients  of  variation: 


/NP. (1-P. 

CV  =  2- 1 

j      MP. 
J       3 

Using  N  =  20, 000 8  these  coefficients  were  computed  using  the 
results  from  the  approximate  parameters  and  are  listed  in 
Table  II.   This  table  also  lists  for  each  X.  the  interval 
extending  two  standard  deviations  on  either  side  of  the  mean 
in  which  we  expect  .955  of  all  realizations  to  fall. 

Thus,  we  may  conclude  that  when  normalized  by  the  num- 
ber of  people  in  that  rank,  the  variation  is  greatest  in 
rank  6  and  decreases  as  j  decreases  to  2.   This  is,  of  course, 
intuitively  appealing  since  the  officers  in  state  6  have  ex- 
perienced the  largest  number  of  state  transitions. 


1  Jsnuary  1971  U.  S.  Marine  Corps  total  was  21,320 


TABLE  II.   MEASURES  OF  VARIATION 

D  nv  Coefficient         NP . ±2/NP . (1-P . ) 

Rank  of  Variation  j     j  v   j-* 

1  .014  3900  ±  112 

2  .012  4940  ±  121 

3  .015  3700  ±  109 

4  .017  2940  ±  100 

5  .018  2660  ±   96 

6  .022  1860  ±   82 

This  completes  the  remarks  on  the  steady  state.  In  the 
following  section,  we  shall  consider  the  effect  of  an  in- 
crease or  decrease  in  the  total  number  of  officers  in  the 
system  and  evaluate  transient  results. 
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IV.   TRANSIENT  RESULTS 

Realistically,  a  graded  personnel  system  which  under- 
goes even  occasional  policy  changes  never  actually  reaches 
a  steady  state.   Thus,  analysis  of  the  transient  reaction 
of  the  system  to  a  given  policy  change  is  necessary  if  the 
effects  of  such  a  change  are  to  be  well  understood. 

In  (2)  we  defined  P..(t)  as  the  probability  an  officer's 
rank  at  t  is  j,  given  he  started  in  i  at  time  zero.   Through- 
out this  paper  we  have  assumed  that  Q(t)  can  be  constructed 
from  known  data  and  can  be  considered  as  given.   Even  so, 
the  direct  determination  of  P(t)  appears  to  be  a  difficult 
task.   Hence,  it  is  desirable  to  develop  a  method  to  "ac- 
curately'1 approximate  P(t). 

The  relationship  between  P(t)  and  £(t)  was  stated  in 
(7)  as 

P(t)  =  ffD(t)  +  Q    *  P(t)  , 

and  taking   Laplace    Stieltjes    transforms    and   rewriting    (11) 
we   obtain 

oo 

P(s)    =    £     Q(s)n  fD(s), 
n=0 

so  that,  after  inverting, 

oo 

P(t)  =  £  QM    *  SD(t),  (21) 

n=0 

where  Q^  (t)    is  the  ntn  fold  convolution  of  Q   t)  with  it- 
self and  ^°)  (t)  =  P. 
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Since  the  expression  for  P(t)  in  (21)  requires  the 
matrix  convolution  of  £?(t)  with  itself  for  all  n  =  1,2,3,... 
we  seek  simpler  expressions  which  give  bounds  or  approxima- 
tions to  p(t) . 

First,  1  is  certainly  an  upper  bound  for  P..(t).   If 
we  substitute  P(t)  =  1    in  the  right  hand  side  of  (7)  we  can 
write : 

P(t)   <  tfD(t)   +  Q     *     1     =  flD(t)   +  Hit), 

where  #(t)  is  a  matrix  whose  ith  row  contains  elements  H. (t) 
A  second  iteration,  substituting  the  right  hand  side  above 
for  P(t)  yields 

P(t)  <  tfD(t)  +  Q    *  [tfD(t)  +  ff(t)] 

<  ID(t)  +  [Q    *   »D(t)3  +  [Q    *  ff(t)], 

and  by  continuing  this  process,  we  have  after  n+1  iterations 

n 

pm  <  y,  qW  *•  vt}  +  $(n)  *  ff(t)'    (22) 

k=0 

As  n+°°  the  term  Q^n'  *Hit)+Q    so  that  this  iterative  process 
does  converge  to  P(t)  as  defined  in  (21). 

Certainly,  P--(t)>0,  and  an  identical   iterative  cal- 
culation shows  that 

n 

PM   >  ]T  qw  *  vt}-  (23) 

k=0 

Thus,  by  combining  (22)  and  (23)  we  have 

n 

0    <   Pit)     -    Y     QW    *  »D(t)  5  <2(n  +  1)  *  *•     (24) 

k=0 
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By  choosing  n  large  enough  we  can  estimate  P(t)  by 


n 


I 


QW    *  ^D(t) 


k=0 
to  any  desired  accuracy. 

In  Part  II  a  system  of  constant  size  N  was  considered 
and  no  changes  in  total  size  over  time  were  investigated. 
Let  us  now  consider  an  increase  in  total  size  generated  by 
increased  inputs  into  state  1,  i.e.,  the  number  of  new  re- 
cruits to  the  system  exceeds  the  number  departing  from  the 
system  in  a  time  period.   This  may  be  done  on  a  one-time 
basis  at  a  time  we  shall  call  zero,  or  by  adding  different 
amounts  each  year  for  several  successive  years,  starting  at 
time  zero.   Figure  3  depicts  this  type  increase. 

Let  n(t)  =  the  number  added  at  time  t  which  are  in 
excess  of  those  needed  to  replace  departures  from  the  system. 
Then  N(t) ,  the  total  system  size  at  time  t  may  be  defined 

as 

t 

N(t)  =  N  +  V    n(u)   .  (25) 

u=0 

This  system  is  still  "closed"  and  the  concept  of  immediate 
replacement  of  departures  applies  for  the  entire  N(t) .   If 
we  assume  the  original  system  of  N  officers  was  in  the  steady 
state  at  time  zero,  the  analysis  of  that  group  can  be  con- 
ducted as  discussed  in  Part  III.   To  derive  information 
concerning  the  entire  system  we  can  superimpose  the  tran- 
sient results  of  the  added  cohorts  onto  the  oi     ;inal  system 
results . 
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Figure  3.   Size  Increase. 

Let  Y.(t)  be  the  number  of  officers  from  those  extra 
cohorts  added  at  time  zero  and  after  that  are  in  rank  j  at 
time  t.   Thus 


Y(t)  =  [Y^t),  Y2(t),...,Y6(t)] 


Similarly  define  S.(t)  and  the  vector  S(t)  for  the  total 
system.   Then 


[Yj(t)]  =  Z  n(t_u)  pij(u) 


(26) 


u=0 


and  the  vector  of  expected  numbers  of  officers  in  the  total 
system  that  are  in  the  various  ranks  at  time  t  is  given  by 
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E[S(t)]    E[X(<»)]  +  E[Y(t)] 

NPX  +  E^Ct)] 

NP2  +  E[Y2(t)] 


NP 


6  +  E[Yfi(t)] 


(27) 


We  see  that  to  calculate  (27),  E[Y.(t)]  is  needed,  and  from 
(26)  this  requires  knowledge  of  P, - (u) ,  u  5  t.   These  P,.(t)'s 
can  be  approximated  by  (24)  . 

As  discussed  previously,  the  joint  distribution  of  the 
number  in  each  rank  at  time  t  for  a  particular  cohort  input 
is  multinomial.  By  assumption,  each  cohort  is  a  MSMP  which 
is  independent  of  all  other  cohorts.   Thus 

t 

[YjCt)]  =  £  n(t-u)  Plj(u)(l-P..  (u)),       (28) 


VI 


u=0 


and 


COV[Yi(t),Yj  (t)]  =  -  £  n(t-u)  Pn(u)  P± .  (u)  .  (29) 


u 


=  0 


Forming  the  covariance  matrix  V[Y(t)]  from  (28)  and  (29) 
it  follows  that 


V[S(t)]  =  V[X(oo)]  +  V[Y(t)] 


(30) 


To  measure  the  effect  of  policy  changes  in  the  transient 
case,  we  must  first  translate  these  changes  in  3  a  new  Q(t). 
Then,  using  (24),  we  can  estimate  P(t) .   If  policy  changes 


31 


and  an  increase  in  overall  size  are  to  be  effected  simultan- 
eously, we  can  consider  the  entire  system  to  be  non-stationary 
and  revise  (26)  to 


E[S(t)]  =  E[W(t)]  +  E[Y(t)] 

where  , 

o 

EtW^t)]  =  £  NPi  P^Ct),   j  =  1,2,. ..,6. 

i=l 

Similarly,  P..(t)  replaces  P.  in  all  calculations  for  V[X(t)] 

which  is  subsequently  used  in  a  revised  (30) . 

The  next  case  to  be  considered  is  a  decrease  in  overall 
size,  initiated  by  a  decrease  in  the  number  of  new  officers 
entering  rank  1;  that  is,  the  number  of  officers  leaving 
the  system  in  a  time  period  is  greater  than  the  number  of 
replacements.   This  may  be  viewed  as  merely  a  diminished 
recruiting  input  to  gradually  reduce  size,  or  as  forced  at- 
trition in  the  higher  ranks  with  a  revised  Q{f)    that  causes 
more  "departures"  to  state  1,  where  "replacement"  is  no 
longer  on  an  instantaneous  one-to-one  basis.   A  major  force 
reduction  would  undoubetdly  be  a  combination  of  both  policies 

Let  the  size  of  the  officer  corps  prior  to  time  zero  be 
N,  and  assume  steady  state  conditions.   Let  N'  <  N  be  the 
desired  new  size.   Then  a  system  of  size  (N-N1)  must  be 
emptied  to  reach  this  objective  size.   Figure  4  depicts  this 
process . 

At  time  zero  we  establish  a  subsystem  of  size  N' ,  whose 
members  are  chosen  randomly  such  that  the  propc  rtions  of 
officers  in  each  rank  are  equal  to  those  of  th   larger  size 
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Figure  4.   Size  Reduction. 

N  system.   These  N'  officers  will  proceed  in  the  previously 
defined  closed  system  model  -  in  either  the  steady  state  or 
transient  mode,  as  appropriate.   However,  the  (N-N'l  other 
officers  are  placed  in  an  open  system,  where  state  0  is  de- 
fined as  "out  of  the  service."   Distinguishing  the  open  sys- 
tem by  *,  we  have  then  Q*(t)  for  this  open  portion  as: 


«*(t)  = 


0 

0 

0 

0 

0 

0 

0 

Q10(t) 

0 

^12 

:to 

0 

0 

0 

0 

W*) 

0 

0 

Q23(t) 

0 

0 

0 

Q30(t) 

0 

0 

0 

Q34(t) 

0 

0 

%0W 

0 

0 

0 

0 

Q45(t) 

0 

Qso^ 

0 

0 

0 

0 

0 

^56^ 

%<>W 

0 

0 

0 

0 

0 

0 

For  this  sub-system,  H*(t)  =  E  Q*.(t)  =  0.  Thus,  H*(t)  =  1 
and  using  the  approximation  (24)  we  can  estima  p*(t).  As 
t-*oo  the  limiting  form  of  P*(t)  is  given  by 
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lim  P*(t)  = 


Thus,  the  expected  remaining  number  in  rank  j, 
E[R.(t)],  in  the  open  system  can  be  calculated  using  the 
transient  part  (states  1  through  6)  of  P*(t);  i.e., 

6 

B[Rj(t)]  =  £  ^N"N'^  Pi  pij(t)' 
i  =  l 

As  P?j(t)->0  rank  j  empties  to  zero.   Thus  the  expected 
number  in  the  open  subsystem,  shown  as  the  shaded  area  in 
Figure  4,  decreases  to  zero  and  the  total  objective  size 
N1  is  reached.   Considering'  the  system  as  a  whole,  we  have 


EfS^t)] 


N 


E[W\(t)]  +  E[Rj(t)];  j  =  1,2,...  ,6. 


To  conclude  this  section,  we  note  that  a  logical  next 
step  in  the  utilization  of  this  model  is  the  construction 
of  Q(t)    from  actual  policy  and  data.   For  example,  consider 
a  simple  development  of  Q,  .  (t) .   Let 

a  =  attrition  rate  from  rank  1  due  to  death,  disability, 
dismissal ,  etc . , 

3  =  opportunity  for  promotion . 

T  =  time  in  grade  1  until  promotion  atter 

EOS  >  T. 
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Then, 

Qn(t)  =  QJ0(t)  =  l-Cl-a)1  t<T 

=  l-(l-a)T+(l-6)(l-a)T[l-(l-a)t"T]t<E0S 

=  l-(l-a)T3  t>EOS 

Q12(t)  =  Qf2(t)  -  0  t<T 

=  3(l-a)T  t>T 

Q(t)    may  then  be  substituted  into  (24)  to  obtain  an 
estimate  of  P(t) .   Analysis  of  estimation  errors  involved 
and  the  number  of  convolutions  necessary  to  achieve  the 
desired  accuracy  can  then  be  conducted. 
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